Stein V ariational Gradient Descent (SVGD) is a nonparametric particle-based deterministic sampling algorithm.

Although the population (i.e, infinite-particle) limit dynamics of SVGD is well characterized, its behavior in the finite-particle regime is far less understood.

Neural Information Processing Systems http://nips.cc/

Neural transport augmented sampling, firstintroduced byParnoandMarzouk (2018),isageneral method for using normalizing flows to sample from a given densityπ. Thus, samples can be generated fromπ(θ)by running MCMC chain in theZ-space and pushing these samples onto theΘ-space usingT. Neural transport augmented samplers havebeen subsequently extended by Hoffman etal. In this paper, we proposed equivariant Stein variational gradient descent algorithm for sampling fromdensities thatareinvarianttosymmetry transformations. Another contributionofourworkis subsequently using this equivariant sampling method to efficiently train equivariant energy based models forprobabilistic modeling andinference.

Subsequently,wedefineequivariant energy based models to model invariant densities that are learned using contrastivedivergence.

We propose a new Stein self-repulsive dynamics for obtaining diversified samples from intractable un-normalized distributions.